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Abstract.  The  Tikhonov-Phillips  method  is  widely  used  for  regularizing  ill-posed 
inverse  problems  mainly  due  to  the  simplicity  of  its  formulation  as  an  optimization 
problem.  The  use  of  different  penalizers  in  the  functionals  associated  to  the 
corresponding  optimization  problems  has  originated  a  variety  other  methods  which 
can  be  considered  as  “variants”  of  the  traditional  Tikhonov-Phillips  method  of  order 
zero.  Such  is  the  case  for  instance  of  the  Tikhonov-Phillips  method  of  order  one,  the 
total  variation  regularization  method,  etc.  In  this  article  we  find  sufficient  conditions  on 
the  penalizers  in  generalized  Tikhonov-Phillips  functionals  which  guarantee  existence 
and  uniqueness  and  stability  of  the  minimizers.  The  particular  cases  in  which  the 
penalizers  are  given  by  the  bounded  variation  norm,  by  powers  of  seminorms  and  by 
linear  combinations  of  powers  of  seminorms  associated  to  closed  operators,  are  studied. 
Several  examples  are  presented  and  a  few  results  on  image  restoration  are  shown. 
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1.  Introduction 

In  a  quite  general  framework  an  inverse  problem  can  be  formulated  as  the  need  for 
determining  x  in  an  equation  of  the  form 

Tx  =  y,  (1) 

where  T  is  a  linear  bounded  operator  between  two  infinite  dimensional  Hilbert  spaces 
X  and  Y  (in  general  these  will  be  function  spaces),  the  range  of  T,  1Z(T ),  is  non-closed 
and  y  is  the  data,  supposed  to  be  known,  perhaps  with  a  certain  degree  of  error.  It 
is  well  known  that  under  these  hypotheses,  problem  (1)  is  ill-posed  in  the  sense  of 
Hadamard  ([11])-  In  this  case  the  ill-posedness  is  a  result  of  the  unboundedness  of  T\ 
the  Moore-Penrose  generalized  inverse  of  T.  The  Moore-Penrose  generalized  inverse  is 
a  fundamental  tool  in  the  treatment  of  inverse  ill-posed  problems  and  their  regularized 
solutions,  mainly  due  to  the  fact  that  this  operator  is  strongly  related  to  the  least- 
squares  solutions  of  problem  (1).  In  fact,  the  least-squares  solution  of  minimum  norm 
of  problem  (1),  also  known  as  the  best  approximate  solution,  is  ad  =  T'y,  which  exists 
if  and  only  if  y  e  V(T t)  =  7 Z(T)  ©  1Z{T)L.  Moreover,  for  y  e  V{T t),  the  set  of  all 
least-squares  solutions  of  problem  (1)  is  given  by  ad  +  Af(T),  where  A f{T)  denotes  the 
null  space  of  the  operator  T. 

The  unboundedness  of  has  as  undesired  consequence  the  fact  that  small 
errors  or  noise  in  the  data  y  can  result  in  arbitrarily  large  errors  in  the 
corresponding  approximated  solutions  (see  [18],  [17]),  turning  unstable  all  standard 
numerical  approximation  methods,  making  them  unsuitable  for  most  applications  and 
inappropriate  from  any  practical  point  of  view.  The  so  called  “regularization  methods” 
are  mathematical  tools  designed  to  restore  stability  to  the  inversion  process  and  consist 
essentially  of  parametric  families  of  continuous  linear  operators  approximating  Td  The 
mathematical  theory  of  regularization  methods  is  very  wide  (a  comprehensive  treatise 
on  the  subject  can  be  found  in  the  book  by  Engl,  Hanke  and  Neubauer,  [9])  and  it  is  of 
great  interest  in  a  broad  variety  of  applications  in  many  areas  such  as  Medicine,  Physics, 
Geology,  Geophysics,  Biology,  image  restaurarion  and  processing,  etc. 

There  exist  numerous  ways  of  regularizing  an  ill-posed  inverse  problem.  Among 
the  most  standard  and  traditional  methods  we  mention  the  Tikhonov-Phillips  method 
([15],  [19],  [20]),  truncated  singular  value  decomposition  (TSVD),  Showalter’s  method, 
total  variation  regularization  ([1]),  etc.  Among  all  regularization  methods,  probably  the 
best  known  and  most  commonly  and  widely  used  is  the  Tikhonov-Phillips  regularization 
method,  which  was  originally  proposed  by  Tikhonov  and  Phillips  in  1962  and  1963  (see 
[15],  [19],  [20]).  Although  this  method  can  be  formalized  within  a  very  general  framework 
by  means  of  spectral  theory  ([9],  [7]),  the  widespread  of  its  use  is  undoubtedly  due  to 
the  fact  that  it  can  also  be  formulated  in  a  very  simple  way  as  an  optimization  problem. 
In  fact,  the  regularized  solution  of  problem  (1)  obtained  by  applying  Tikhonov-Phillips 
method  is  the  minimize!'  xa  of  the  functional 
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where  a  is  a  positive  constant  known  as  the  regularization  parameter. 

The  penalizing  term  a  ||a:||2  in  (2)  not  only  induces  stability  but  it  also  determines 
certain  regularity  properties  of  the  approximating  regularized  solutions  xa  and  of  the 
corresponding  least-squares  solution  which  they  approximate  as  a  — »  0+.  Thus, 
for  instance,  it  is  well  known  that  minimizcrs  of  (2)  are  always  “smooth”  and,  for 
a  — >  0+,  they  approximate  the  least-squares  solution  of  minimum  norm  of  (1), 
that  is  lima_>0+  xa  =  T^y.  This  method  is  more  precisely  known  as  the  Tikhonov- 
Phillips  method  of  order  zero.  Choosing  other  penalizing  terms  gives  rise  to  different 
approximations  with  different  properties,  approximating  different  least-squares  solutions 
of  (1).  Thus,  for  instance,  the  use  of  ||  v^ll 2  as  penalizer  instead  of  ||x||2  in  (2)  originates 
the  so  called  Tikhonov-Phillips  method  of  order  one,  the  penalizer  ||a;||BV  (where  ||-||BV 
denotes  the  bounded  variation  norm)  gives  rise  to  the  so  called  bounded  variation 
regularization  method  introduced  by  Acar  and  Vogel  in  1994  ([1]),  etc.  In  particular,  in 
the  latter  case,  the  approximating  solutions  are  only  forced  to  be  of  bounded  variation 
rather  than  smooth  and  they  approximate,  for  a  — »  0+,  the  least-squares  solution  of 
problem  (1)  of  minimum  ||-||BV-norm  (see  [1]).  This  method  has  been  proved  to  be  a 
good  choice,  for  instance,  in  certain  image  restoration  problems  in  which  it  is  highly 
desirable  to  detect  and  preserve  sharp  edges  and  discontinuities  of  the  original  image. 

Hence,  the  penalizing  term  in  (2)  is  used  not  only  to  stabilize  the  inversion  of 
the  ill-posed  problem  but  also  to  enforce  certain  characteristics  on  the  approximating 
solutions  and  on  the  particular  limiting  least-squares  solution  that  they  approximate. 
As  a  consequence,  it  is  reasonable  to  assume  that  an  adequate  choice  of  the  penalizing 
term,  based  on  a-priori  knowledge  about  certain  characteristics  of  the  exact  solution  of 
problem  (1),  will  lead  to  approximated  “regularized”  solutions  which  will  appropriately 
reflect  those  characteristics. 

With  the  above  considerations  in  mind,  we  shall  consider  functionals  of  the  form 
Jw,a(x)  =  \\Tx  -  y\\2  +  <*W{x)  xev,  (3) 

where  W  ( • )  is  an  arbitrary  functional  with  domain  Pcf  and  a  is  a  positive  constant. 

The  purpose  of  this  article  is  to  find  sufficient  conditions  on  the  penalizers  in 
generalized  Tikhonov-Phillips  functionals  of  the  form  (3)  which  guarantee  existence 
and  uniqueness  and  stability  of  the  minimizers.  The  particular  cases  in  which  the 
penalizers  are  given  by  the  bounded  variation  norm,  by  powers  of  seminorms  and  by 
linear  combinations  of  powers  of  seminorms  associated  to  closed  operators,  are  studied. 
Several  examples  are  presented  and  a  few  results  on  image  restoration  are  shown. 

2.  Existence  and  uniqueness  for  general  penalizing  terms 

In  this  section  we  shall  consider  the  problem  of  finding  conditions  on  the  penalizer  kP(-) 
which  guarantee  existence  and  uniqueness  of  global  minimizers  of  (3).  Previously  we 
will  need  to  introduce  a  few  definitions. 
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Definition  2.1.  Let  X  be  a  vector  space,  W  a  functional  defined  over  a  set  V  C  X  and 
A  a  subset  of  V .  We  say  that  A  is  W -bounded  if  there  exists  a  constant  k  <  oo  such 
that  |W(a)|  <  k  for  every  a  E  A. 

Definition  2.2.  (W -coercivity)  Let  X  be  a  vector  space  and  W ,  F  two  functionals 
defined  on  a  setV  C  X .  We  say  that  the  functional  F  is  W -coercive  if  lim  F(xn)  =  +oo 

n— xx) 

for  every  sequence  {xn}  C  V  for  which  lim^oo  W(xn )  =  +oo. 

Remark  2.3.  Note  that  if  the  functional  F  is  W -coercive  and  W  is  bounded  from  below, 
then  all  lower  level  sets  for  F,  i.e.  all  sets  of  the  form  {x  £  V  :  F(x)  <  a}  with  a  E  IR 
are  W -bounded  sets. 

Definition  2.4.  Let  X  be  a  normed  vector  space,  W,  F  two  functionals  with  Dom(F)  C 
Dom{W )  C  X.  We  say  that  F  is  W -sub sequentially  (weakly)  lower  semicontinuous  if 

for  every  W -bounded  sequence  {xn}  C  Dom(F)  such  that  xn  — >  x  E  Dom(F),  there 
exists  a  subsequence  {xnj}  C  {xn}  such  that  F{x)  <  liminfj^oo  F(xnj).  If  F  is  W- 
sub sequentially  lower  semicontinuous  we  will  simply  say  that  F  is  W -sis.  Similarly,  if 
F  is  W -sub sequentially  weakly  lower  semicontinuous  we  will  say  that  F  is  W-swls. 

In  the  following  theorem,  sufficient  conditions  on  the  operator  T  and  on  the 
functional  W  guaranteeing  the  existence  and  uniqueness  of  the  minimizer  of  the 
functional  (3)  are  established. 

Theorem  2.5.  (Existence  and  uniqueness)  Let  X,  y  be  normed  vector  spaces,  T  E 
C(x,y),  y  ey,v  C  X  a  convex  set  and  W  :  E  — »  M  a  functional  bounded  from 
below,  W -sub sequentially  weakly  lower  semicontinuous,  and  such  that  W -bounded  sets 
are  relatively  weakly  compact  in  X .  More  precisely,  suppose  that  W  satisfies  the  following 
hypotheses: 

•  (HI):  3  7  >  0  such  that  W{x)  >  —7  V x  E  V. 

•  (H2):  for  every  W -bounded  sequence  {xn}  C  D  such  that  xn  A  x  E  V ,  there  exists 
a  subsequence  {xrij }  C  {xn}  such  that  W(x)  <  lim  infj^oc,  W(xn;i ) . 

•  (H3):  for  every  W -bounded  sequence  {xn}  C  D  there  exist  a  subsequence  {xnj}  C 
{xn}  and  x  E  V  such  that  xnj  x. 

Then  the  functional  Jw,a{-)  In  (3)  has  a  global  minimizer.  If  moreover  W  is  convex  and 
T  is  injective  or  W  is  strictly  convex,  then  such  a  minimizer  is  unique. 

Proof.  First  we  note  that  for  every  sequence  {zn}  cDwe  have  that 

zn  2  =*►  || Tz  -  y\\2  <  lim  inf  \\Tzn  -  y\\2  .  (4) 

n— xx 

This  follows  immediately  from  the  continuity  of  T  and  the  weak  lower  semicontinuity 
of  the  norm. 

Let  now  {xn}  C  V  be  such  that 
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Hypothesis  (HI)  guarantees  that  —  oo  <  Jmin  <  +oo.  From  the  definition  of  Jw<a(-) 
and  since  a  >  0  it  follows  that  Jw,a  ( • )  is  W- coercive.  Suppose  now  that  the  sequence 
{xn}  is  not  IF-bounded.  Then,  there  exists  a  subsequence  {xnj}  C  {xn}  such  that 
W{xnf)  — >  oo,  from  which,  by  virtue  of  the  hF-coercivity  of  JWia(-)  it  follows  that 
Jw,y {xn. )  — >  oo.  This  contradicts  (5).  Thus  the  sequence  {xn}  is  f'F-bounded.  It  then 
follows  by  hypothesis  (H3)  that  there  must  exist  a  sequence  {xnj}  C  {xn}  and  x  G  V 
such  that  xnj  x  and  since  W  satisfies  (H2)  there  exists  a  subsequence  {xnjk}  of  {xnj} 
such  that 


Then 


W (x)  <  lim  inf  W (x, 

k—KX) 


'Ok  ' 


(6) 


JwAV  =  \\Tx  -  all2  +  aW(x) 


<  lim  inf 

k — >oo 

<  lim  inf 

k — >oo 


T Xnik  -  y 


Txnjk  -  y 


+  a  lim  inf  W  (xr 


k^oo 


'Ok  ' 


+  aW  (x, 


’Ok  - 


(by  (4)  and  (6)) 

(by  prop,  of  liminf) 
(by  def.  of  JW,J 


=  liminf  JwJxn.) 

k — >oo  K 

=  lim  J Wa (xn)  (by  (5)  and  since  {xn.  }  is  a  subseq.  of  {a:n}) 

n— xx)  ’  3k 

J min  • 


It  then  follows  that  JW}C,(x )  =  -/min-  This  proves  the  existence  of  a  global  minimizer  of 
(3).  For  the  uniqueness,  note  that  under  the  hypothesis  that  W  be  convex  and  T  be 
injective  or  W  be  strictly  convex,  one  has  that  the  functional  JWta(-)  is  strictly  convex 
and  therefore  the  global  minimizer  is  unique.  ■ 


Remark  2.6.  Note  that  in  the  previous  theorem  the  convexity  of  V  is  not  needed  for 
the  existence.  Note  also  that  if  we  replace  hypotheses  (H2)  and  (H3)  on  the  functional 
W  by  the  assumptions  that  W  be  W -sis  and  that  W -bounded  sets  be  relatively  compact 
in  X ,  i.e.  by  the  following  hypotheses: 

•  (H2’):  for  every  W -bounded  sequence  {a:n}  C  V  such  that  xn  — >  x  G  V,  there  exists 
a  subsequence  {xnj}  C  {xn}  such  that  W (x)  <  lim infi,-.^  W(xnj); 

•  (H3’):  for  every  W -bounded  sequence  {xn}  C  V  there  exist  a  subsequence  {xnj}  C 
{a;n}  and  x  G  V  such  that  xnj  — >  x, 

then  both  existence  and  uniqueness  remain  valid. 

Remark  2.7.  Note  that  hypothesis  (H3’)  is  stronger  than  (H3)  which,  in  turn,  is 
stronger  than  the  hypothesis  that  every  W -bounded  set  be  weakly  precompact.  Also, 
( H2  )  is  weaker  than  (H2)  which  in  turn  is  weaker  than  the  hypothesis  that  W  be  weakly 
lower  semicontinuous. 
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Remark  2.8.  If  X  is  a  reflexive  Banach  space  and  W{-)  is  a  norm  defined  on  a  subspace 
V  of  X ,  which  is  on  V  equivalent  or  stronger  that  the  norm  of  X,  then  it  follows  that 
W  satisfies  hypothesis  (HI),  (H2),  (H3)  and  therefore  the  functional  (3)  has  a  global 
minimizer  on  V.  If  moreover  T  is  injective  or  the  normed  space  (V,  W(-) )  is  complete 
and  separable  or  Hilbert,  then  such  a  minimizer  is  unique. 

Observe  that  hypothesis  (HI),  (H2)  and  (H3)  as  well  as  (H2’)  and  (H3j  impose 
conditions  only  on  the  penalizer  W{-)  and  not  on  T,  so  that  the  corresponding  existence 
and  uniqueness  results  hold  for  any  bounded  linear  operator  T.  It  is  therefore  not 
surprising  that  those  conditions  can  be  relaxed  if  some  information  on  T  in  connection 
to  W(-)  is  provided.  The  next  theorem  shows  a  result  in  this  direction. 

Theorem  2.9.  Let  X,  y  be  normed  spaces,  T  e  £(X,y),  V  C  X  a  convex  set  and  W 
a  real  functional  on  V.  Consider  the  following  standing  hypotheses: 

•  (12):  W  is  T-W-swls,  i.e  for  every  sequence  {xn}  C  D  such  that  {||Ta;n||  -\-W(xn)} 
is  bounded  in  M  (in  the  sequel  we  shall  refer  to  such  a  sequence  as  a  ‘T-W  bounded 
sequence”)  and  xn  x  G  D,  there  exists  a  subsequence  {xn  }  C  {xn}  such  that 
W (x)  <  lim  inf^oc  W (xnj ) . 

•  (13):  T -W -bounded  sets  are  relatively  weakly  compact  in  X,  i.e.,  for  every  T-W- 
bounded  sequence  {xn}  C  D  there  exist  a  subsequence  {xnj}  C  {xn}  and  x  G  V 
such  that  xnj  —>  x. 

If  T  andW(-)  satisfy  the  hypotheses  (HI),  (12)  and  (13),  then  the  functional  Jw,a(- )  in 
(3)  has  a  global  minimizer.  If  moreover  W  is  convex  and  T  is  injective  or  W  is  strictly 
convex,  then  such  a  minimizer  is  unique. 

Proof.  Let  {xn}  be  a  minimizing  sequence  of  Jw.a(j-  From  the  definition  of  Jw,a(')  it 
follows  that  {xn}  is  T- IT-bounded.  Then  by  (13)  there  must  exist  {xnj}  C  {xn}  and 
x  G  D  such  that  xnj  A  x.  Now  by  virtue  of  (12)  there  exists  {xnjk}  C  { xnj }  such 
that  W(x)  <  liminffc-njo  W(xnj  ).  Following  now  the  same  steps  as  in  Theorem  2.5  we 
obtain  that 

Jw,a(x)  =  min  JWa(x). 

xClD 

If  W  is  convex  and  T  is  injective  or  W(-)  is  strictly  convex,  uniqueness  follows  from  the 
strict  convexity  of  Jw,a(j  on  D.  ■ 

Remark  2.10.  Note  that  hypotheses  (12)  and  (13)  are  weaker  that  (H2)  and  (H3), 
respectively.  Also  note  that  both  (12)  and  (13)  hold,  for  instance  if  X  is  reflexive,  W(-) 
is  sub  sequentially  weakly  lower  semicontinuous  and  T  and  W  are  complemented,  i.e. 
there  exists  a  positive  constant  c  such  that  ||Ta;||2  +  hF(a;)  >c||a;||2Va:GT). 

Remark  2.11.  Just  like  in  Theorem  2.5,  in  Theorem  2.9,  the  convexity  of  V  is  not 
needed  for  the  existence.  Also  note  that  if  hypothesis  (12)  and  (13)  are  replaced  by  the 
assumption  that  W  be  T-W -sis  and  that  T -W -bounded  sets  be  relatively  compact  in  X, 
i.e.  by  the  hypoteses: 
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•  (12’):  for  every  T -W -bounded  sequence  {xn}  C  V  such  that  xn  — >  x  €  V,  there 
exists  a  subsequence  {xnj}  C  {a;n}  such  that  W (x)  <  lim inf ^->00  W (xnj ) ; 

•  (13’):  for  every  T-W -bounded  sequence  {xn}  C  D  there  exist  a  subsequence 
{xnj}  C  {xn}  and  x  G  V  such  that  xnj  — >  x, 

then  the  results  of  Theorem  2.9  remain  valid. 

3.  Stability 

As  it  was  previously  mentioned,  inverse  ill-posed  problems  appear  in  a  wide  variety 
of  applications  in  diverse  areas.  Solving  these  problems  usually  involves  several  steps 
starting  from  modeling,  through  measurements  and  data  acquisition  for  the  experiment 
under  study,  to  the  discretization  of  the  mathematical  model  and  the  derivation  of 
numerical  approximations  for  the  regularized  solutions.  All  these  steps  entail  intrinsic 
errors,  many  of  which  are  unavoidable.  For  this  reason,  in  the  context  of  the  study 
of  inverse  ill-posed  problems  from  the  optic  of  Tikhonov-Phillips  methods  with  general 
penalizing  terms,  it  is  of  particular  interest  to  analyze  the  stability  of  the  minimizers  of 
the  functional  (3)  under  different  types  of  perturbations.  To  proceed  with  some  results 
in  this  direction  we  shall  need  the  following  definitions. 

Definition  3.1.  (W -coercivity)  Let  X  be  a  vector  space,  W,  Fn,  n  —  1,2,.. .?  functionals 
defined  on  a  set  V  C  X.  We  will  say  that  the  sequence  {Fh}  is  W -coercive  if 
limTWOC  Fn(xn )  =  +oo  for  every  sequence  {xn}  C  V  for  which  lim,woo  W{xn)  =  +oo. 

Definition  3.2.  (consistency)  Let  X  be  a  vector  space  and  W,F,Fn,n  =  1,2,..., 
functionals  defined  on  a  set  V  C  X .  We  will  say  that  the  sequence  {Fh}  is  consistent 
for  F  if  Fnx  — >  Fx  for  every  x  G  V.  We  will  say  that  the  sequence  {Fn}  is  W -uniformly 
consistent  for  F  if  Fnx  — >  Fx  uniformly  on  every  W -bounded  set,  that  is  if  for  any  given 
c  >  0  and  e  >  0,  there  exists  N  =  N(c,  e)  such  that  \Fn(x)  —  F(x) \  <  e  for  every  n  >  N 
and  every  x  G  V  such  that  |W(x)|  <  c. 

In  the  following  theorem  we  present  a  weak  stability  result  for  the  minimizers  of  a 
general  functional  on  a  norrned  space. 

Theorem  3.3.  Let  X  be  a  norrned  vector  space,  V  a  subset  of  X,  W  :  V  — >  M  a 
functional  satisfying  the  hypotheses  (HI)  and  (H3)  of  Theorem  2.5  (i.e.  there  exists 
7  >  0  such  that  W(x)  >  —7  for  every  x  G  D  and  every  W -bounded  sequence  contains 
a  weakly  convergent  subsequence  with  limit  in  V),  J,  Jn,  n  =  1,2,...,  functionals  on 
V  such  that  J  is  W -swls  and  {Jn}  is  W -coercive  and  W -uniformly  consistent  for  J . 
Assume  further  that  there  exists  a  unique  global  minimizer  x  G  V  of  J  and  that  each 
functional  Jn  also  possesses  onV  a  global  minimizer  xn  (not  necessarily  unique).  Then 

W  _ 

Xn  >  X. 


Solutions  of  generalized  Tikhonov- Phillips  functionals 


Proof.  Since  for  each  n  G  N,  xn  minimizes  the  functional  Jn  we  have  that  Jn(xn)  < 
Jn(x).  Then 


lim  sup  Jn(xn)  <  lim  sup  Jn(x)  —  J(x)  <  oo,  (7) 

71— XX)  71— XX) 

where  the  equality  follows  from  the  hypothesis  that  the  sequence  {Jn}  is  W-uniformly 
consistent  for  J.  From  (7),  the  hypothesis  (HI)  on  W  and  the  hypothesis  of  W- 
coercitivity  of  { Jn}  it  then  follows  that  the  sequence  { xn }  is  IT-bounded. 

Suppose  now  that  the  sequence  {xn}  does  not  converge  weakly  to  x.  Then  there 
exists  a  subsequence  {xnj}  of  {xn}  such  that  no  subsequence  {xnjk}  of  {xnj}  converges 
weakly  to  x.  On  the  other  hand,  since  the  sequence  {xrij }  is  IT-bounded  (since  the 
original  sequence  is)  hypothesis  (H3)  on  W  implies  that  there  exist  x*  G  T>  and  a 
subsequence  | xn.ik  |  of  { xn. }  such  that  xnjk  A  x*.  It  then  follows  that  x*  x. 

On  the  other  hand,  since  the  sequence  {xnj  }  is  IT-bounded,  xnjk  A  x*  and  J  is 
IT-swls,  it  follows  that  there  exists  a  subsequence  {xnjk  }  C  {xnjk}  such  that 

J(x*)  <  lirninf  j(xn.  V  (8) 

Also,  since  the  sequence  {xnjk  }  is  IT-bounded  and  {Jn}  is  IT-uniformly  consistent  for 
J,  it  follows  that 


Hence 


lim 

£ — >oo 


0. 


(9) 


J(x*)  <  lirninf  J  (xn  ) 

t— >oo  V  3kt  / 

<  lim  sup  J  ( xn.  j 

fi — vr*-)  V  Jke  J 


£ — >oo 

=  lim  sup 


J  I  xnj 


Jn  l  Xn 


-  u“s"p  (J  ( 1 -  T 

=ITTJ”'>.  K«) 

<  J(x). 


(by  (8)) 

«))  +  Jn’H 

))  +  li“7‘  pk(\) 

+  limsupj  (x  )  (by  (9)) 
(by  (9)) 

(by  (7),  since  {xn  }  C  {*„}) 


Since  x  is  the  unique  minimizer  of  J  it  follows  that  x*  =  x,  contradicting  our  previous 
result  that  x*  ^  x.  This  contradiction  came  from  assuming  that  the  sequence  {xn}  did 
not  converge  weakly  to  x.  Hence  xn  x  as  we  wanted  to  show.  ■ 


Note  that  by  virtue  of  Remark  2.7,  the  hypothesis  that  J  be  IT-swls  in  the  previous 
theorem  can  be  replaced  by  the  hypothesis  that  J  be  weakly  lower  semicontinuous  on 
V. 
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In  the  particular  case  in  which  the  functionals  J  and  Jn  are  of  Tikhonov-Phillips 
type,  under  certain  general  conditions  on  the  penalizer  W(-),  the  previous  theorem 
yields  a  weak  stability  result  for  the  minimizers  of  the  functional  (3).  In  fact  we  have 
the  following  corollary. 

Corollary  3.4.  Let  X  be  a  normed  vector  space,  y  an  inner  product  space,  T,  Tn  e 
C(X,  y),  n  —  1,  2,  •  •  y  e  y,  a  >  0,  V  a  subset  of  X ,  W  :  V  — ■>  M  a  functional  satisfying 
hypotheses  (HI),  (H2)  and  (H3)  of  Theorem  2.5,  J,Jn,  n  =  1,2,...,  functionals  on  V 
defined  as  follows: 

J(x)  =  \\Tx -y\\2 +  aW(x),  (10) 

Jn(x)  =  \\Tnx  -  yn\\2  +  anW(x),  (11) 

such  that  as  n  — >  oo,  an  — >  a,  yn  — >  y  and  Tnx  — >  Tx  uniformly  for  x  in  W -bounded 
sets  (i.e.  {Tn}  is  W -uniformly  consistent  for  T ).  Suppose  further  that  J  has  a  unique 
global  minimizer  x.  If  xn  is  a  global  minimizer  of  Jn  then  xn  —>  x. 

Proof.  To  prove  this  corollary  it  suffices  to  verify  that  the  functionals  J  and  Jn  satisfy 
the  hypotheses  of  Theorem  3.3,  that  is,  verify  that  J  is  kb-swls  and  that  the  sequence 
{Jn}  is  kb-coercive  and  IT-iuiiformly  consistent  for  J . 

To  prove  that  J  is  kb-swls,  let  {xn}  C  V  be  a  IT-bounded  sequence  such  that 
xn  x  G  V.  From  the  continuity  of  T  and  the  weak  lower  semicontinuity  of  every 
norm,  it  follow  immediately  that 

\\Tx-y\\2  <  lirninf  \\Txn  -  y\\2.  (12) 

n— xx) 

On  the  other  hand,  by  (H2)  it  follows  that  there  exists  a  subsequence  {xnj}  C  {xn} 
such  that 

W(x)  <  lirninf  W(xnf).  (13) 

j^oo 

Then, 

J(x)  =  \\Tx  -  yf  +  aW(x) 

<  lirninf  ||Txn  -  y\\ 2  +  lirninf  aW(xn  )(by  (12)  y  (13)) 

j—>CX3 

<  lim inf { ||Txn.  —  y\\2  +  aW(xn.)}  (by  property  of  lirninf) 

3  ^oo 

=  lirninf  J(xn  ). 

j  ^oo 

Hence  J  is  IT-swls. 

Now  we  will  prove  that  the  sequence  {Jn}  is  IT-coercive.  For  that  let  {xn}  C  V 
such  that  IT (xn)  — >  +cx).  Observe  that 

Jn{xn)  =  || Tnxn  -  yn ||2  +  anW(xn)  >  anW(xn).  (14) 

Since  IT  satisfies  (HI)  and  an  — >  a  >  0,  it  follows  immediately  from  (14)  that 
Jn(xn )  — >  -Too.  Hence  {Jn}  is  uniformly  IT-coercive. 
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Finally  we  will  show  that  {Jn}  is  W-uniformly  consistent  for  J.  For  that  let  M  C  T> 
be  a  I'F-bounclecl  set.  Since  {Tn}  is  IF-uniformly  consistent  for  T  we  have  that  Tnx  — >  Tx 
uniformly  on  M  and  since  yn  — >  y,  it  follows  that  ||Tnx  —  yn ||2  — >  || Tx  —  y\\ 2  uniformly 
on  M .  Finally,  since 

I  Jn(x)  ~  J(x)  |  =  |  ||  Tnx  -  yn  ||2  +  anW(x )  -  ||  Tx  -  yf  -  aW{x)\ 

<  I  || Tnx  -  yn ||2  -  ||Ta;  -  y\\2\  +  \(an  -  a)| \W(x)\,  (15) 

it  follows  that  Jn(x )  — >  J(x)  uniformly  for  x  G  M.  Thus  { Jn}  is  IF-uniformly  consistent 
for  J . 

Since  J  and  {Jn}  satisfy  the  hypotheses  of  Theorem  3.3,  the  corollary  then 
follows.  ■ 

Remark  3.5.  Note  that  by  virtue  of  Remark  2.8,  the  weak  stability  result  of  Corollary 
3.4  holds  if  i)  X  is  a  reflexive  Banach  space,  ii)  the  penalizer  W(-)  in  (10)  is  a  norm 
defined  on  a  subspace  V  of  X  which  is  on  V  equivalent  or  stronger  than  the  original 
norm  in  X  and  in)  T  is  injective  or  the  space  (V,  W(-) )  is  a  separable  Banach  space  or 
a  Hilbert  space. 

Hypotheses  on  Theorem  3.3  and  Corollary  3.4  can  be  weakened  if  adequate 
information  on  the  operator  T  is  available.  Before  we  proceed  to  the  statements  of 
the  corresponding  results,  we  shall  need  the  following  definitions. 

Definition  3.6.  (T-W -coercivity)  Let  X,  y  be  vector  spaces,  T  G  £(X,y),  W, 
Fn ,  n  =  1,2, ... ,  functionals  defined  on  a  set  V  C  X.  We  will  say  that  the  sequence 
{jy  is  T -W -coercive  if  lim,woo  Fn(xn )  =  +oo  for  every  sequence  {a;n}  C  T>  for  which 
lim^oo  ||Ta;n||  +W(xn )  =  +oo. 

Definition  3.7.  (T -W -uniform  consistency)  Let  X,  y  be  vector  spaces,  T  e  C(X,y) 
and  W,F,Fn,n  =  1,2,...,  functionals  defined  on  a  set  V  C  X.  We  will  say  that  the 
sequence  {i7^}  is  T -W -uniformly  consistent  for  F  if  Fn  — >  F  uniformly  on  every  T-W- 
bounded  set,  that  is  if  for  any  given  c  >  0  and  e  >  0,  there  exists  N  =  N(c,  e)  such  that 
| Fn(x)  —  F(x) |  <  e  for  every  n>  N  and  every  x  G  D  such  that  ||Ta;||  +  \W(x)\  <  c. 

Theorem  3.8.  Let  X,  y  be  normed  vector  spaces,  T  G  £(X,y),  V  a  subset  of  X, 
W  :  V  — >  M  a  functional  satisfying  hypotheses  (HI)  of  Theorem  2.5  and  (13)  of 
Theorem  2.9  (i.e.  there  exists  7  >  0  such  that  W(x )  >  —7  for  every  x  G  D  and 
every  T -W -bounded  sequence  contains  a  weakly  convergent  subsequence  with  limit  in 
V),  J ,  Jn,  n  —  1,2, ... ,  functionals  on  V  such  that  J  is  T-W -swls  and  {Jn}  is  T-W- 
coercive  and  T -W -uniformly  consistent  for  J .  Assume  further  that  there  exists  a  unique 
global  minimizer  x  G  V  of  J  and  that  each  functional  Jn  also  possesses  on  V  a  global 
minimizer  xn  (not  necessarily  unique).  Then  xn  A  x. 

Proof.  The  proof  follows  like  in  Theorem  3.3  with  the  obvious  modifications.  ■ 
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Corollary  3.9.  Let  X  be  normed  vector  space,  y  an  inner  product  space,  T,  Tn  e 
C(X,  y) ,  n  =  1,2,  ■  ■  ■,  y  E  y,  a  >  0,  V  a  subset  of  X ,  W  :  V  — >•  M  a  functional  satisfying 
hypotheses  (HI)  of  Theorem  2.5  and  (12)  and  (13)  of  Theorem  2.9,  J,Jn,n  =  1,2,..., 
functionals  on  V  defined  as  follows: 

J(x)  =  \\Tx -y\\2 +  aW(x), 

Jn(x)  =  ||Tnx  -  yn ||2  +  anW(x), 

such  that  as  n  — ■»  oo,  an  — >  a,  yn  — >  y  and  Tnx  — >  Tx  uniformly  for  x  in  W -bounded 
sets  (i.e.  {Tn}  is  W -uniformly  consistent  for  T ).  Suppose  further  that  J  has  a  unique 
global  minimizer  x.  If  xn  is  a  global  minimizer  of  Jn  then  xn  —>  x. 

Proof.  We  will  show  that  J  and  {Jn}  satisfy  the  hypotheses  of  Theorem  3.8.  For 
that  it  suffices  to  show  that  J  is  T-bF-swls  and  that  {Jn}  is  T-W  coercive  and  T- 
IF- uniformly  consistent  for  J.  That  J  is  T-bF-swls  follows  immediately  from  (12)  and 
the  weak  lower  semicontinuity  of  every  norm.  The  T-lF-uniform  consistency  of  {Jn} 
for  J  follows  exactly  as  in  the  proof  of  Corollary  3.4  by  noting  that  \Jn(x)  —  J(x)\  < 
|| Tnx  —  yn 1 1 2  —  \\Tx  —  y||2|  +  | (an  —  a)|  |W(x)|  and  using  the  fact  that  T-lF-bounded 
sets  are  also  IF-bounded.  Finally,  the  T-lF-coercivity  of  {Jn}  follows  easily  from  the 
W- uniform  consistency  of  {Tn}  for  T.  ■ 

Next  we  present  a  strong  stability  result  for  the  minimizers  of  general  functionals 
on  a  normed  space. 

Theorem  3.10.  Let  X  be  a  normed  vector  space,  V  a  subset  of  X ,  W  :  V  — »  M  a 
functional  satisfying  hypotheses  (HI)  of  Theorem  2.5  and  ( H3 ’)  of  Remark  2.6  (i.e., 
there  exists  7  >  0  such  that  W(x)  >  —7  for  every  x  G  D  and  every  W -bounded  sequence 
contains  a  convergent  subsequence  with  limit  in  V),  J,Jn,  n  =  1,2,...,  functionals 
on  V  such  that  J  is  W -sub sequentially  lower  semicontinuous  (W -sis)  and  {Jn}  is  W - 
coercive  and  W -uniformly  consistent  for  J.  Suppose  further  that  J  has  a  unique  global 
minimizer  x  G  V  and  that  each  functional  Jn  also  possesses  onV  a  global  minimizer  xn 
(not  necessarily  unique).  Then  xn  — >  x. 

Proof.  For  each  n  e  N,  let  xn  be  a  global  minimizer  of  Jn.  Following  the  same  steps  as 
those  in  the  proof  of  Theorem  3.3  it  follows  that  the  sequence  {xn}  is  IF-bounded. 

Suppose  now  that  {xn}  does  not  converge  to  x.  Then  there  exists  a  subsequence 
{xnj}  of  {xn}  such  that  no  subsequence  of  {xnj}  converges  to  x.  On  the  other  hand, 
since  the  sequence  { xnj }  is  f'F-bounded  (since  the  original  sequence  is),  hypothesis  ( H3 ’) 

on  the  functional  W  implies  that  there  exist  a  subsequence  |xn^  |  of  { }  and  x*  G  V 
such  that  x„.  — >  x*.  From  this  it  follows  that  x*  +  x  and  since  J  is  f'F-sls,  there  exists 

a  subsequence  |  C  |  such  that 

J(x*)  <  lim  inf  J  (xn  V 

OO  V  °kL  J 


(16) 
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J(x*)  <  liminf  J  (xn.  ) 

l— >oo  V  ) 

J  (  Xn., 


<  limsup 

£ — >oo 


—  Jn  I  X... 

nJke  V  "'3k, 


(by  (16)) 
+  J, 


.  xn 

Oku  V  Jk, 


<  lim sup  \J[x 

£ — >oo 

=  lim  sup  J, 


"3k( 


J‘n 


3k , 


U3k ,  \Xn3kf 


£ — *oo 

<  lim  sup  Jn  ( xn ) 

n— >  OO 

<  lim  sup  Jn  ( x ) 

n— >  OO 

=  J{x). 


(since  {Jn}  is  TT-unif.  consistent  for  J ) 

(since  {xnjk(}  C  {xn}) 

(since  xn  minimizes  Jn ) 

(since  {Jn}  is  IF-unif.  consistent  for  J ) 

Hence  J(x*)  <  J{x )  which  contradicts  the  fact  that  x  ^  x*  and  x*  is  the  unique 
minimizer  of  J.  This  contradiction  came  from  assuming  that  the  sequence  {xn}  does 
not  converge  to  x.  Hence  xr 


x. 


The  previous  theorem  yields  a  strong  stability  result  for  minimizers  of  the  functional 
(3)  in  the  particular  case  in  which  J  and  Jn  are  of  Tikhonov-Phillips  type.  More  precisely 
we  have  the  following  corollary. 

Corollary  3.11.  Let  X  be  a  normed  vector  space,  y  an  inner  product  space,  T,  Tn  e 
C(X ,  y),  n  —  1,  2,  •  •  y  e  y,  a  >  07  V  a  subset  of  X ,  W  :  V  — ■>  M  a  functional  satisfying 
hypotheses  (HI)  of  Theorem  2.5  and  (H2’)  and  ( H3 ’)  of  Remark  2.6,  J,Jn,  n  =  1,2,  ...7 
functionals  on  V  defined  as  follows: 

J(x)  =  \\Tx -y\\2 +  aW(x),  (17) 

Jn(x)  =  || Tnx  -  yn ||2  +  anW(x),  (18) 

such  that  as  n  — >  oo,  an  — >  a,  yn  — >  y  and  Tnx  — >  Tx  uniformly  on  W -bounded  sets 
(i.e.  {Tn}  is  W -uniformly  consistent  for  T ).  Suppose  further  that  J  has  a  unique  global 
minimizer  x.  If  xn  is  a  global  minimizer  of  Jn  then  xn  — ■>  x. 

Proof.  Since  the  proof  is  immediately  obtained  from  Theorem  3.10  following  the  same 
steps  as  in  Corollary  3.4,  we  do  not  give  details  here.  ■ 


Here  again,  the  strong  stability  results  of  Theorem  3.10  and  Corollary  3.11  remain 
valid  under  weaker  hypotheses  involving  both  the  model  operator  T  and  the  penalizer 
W. 

Theorem  3.12.  Let  X  be  a  normed  vector  space,  V  a  subset  of  X,  W  :  V  — >  M 
a  functional  satisfying  hypotheses  (HI)  of  Theorem  2.5  and  (13)  of  Remark  2.11 
(i.e.,  there  exists  7  >  0  such  that  W (x)  >  —7  for  every  x  G  V  and  every  T-W- 
bounded  sequence  contains  a  convergent  subsequence  with  limit  in  V),  J ,  Jn,  n  —  1,  2, ... , 
functionals  on  V  such  that  J  is  T -XV -sub sequentially  lower  semicontinuous  (T -XV -sis) 
and  {Jn}  is  T -XV -coercive  and  T -W -uniformly  consistent  for  J .  Suppose  further  that  J 
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has  a  unique  global  minimizer  x  G  D  and  that  each  functional  Jn  also  possesses  on  V  a 
global  minimizer  xn  (not  necessarily  unique).  Then  xn  — >  x. 

Proof.  The  proof  of  this  theorem  proceeds  exactly  as  the  one  of  Theorem  3.10,  by 
changing  the  W-b oundedness ,  IV-sls,  IV-uniform  consistency  and  ( H3 )  hypoteses  by 
T - W-h oundedness ,  T- IV-sls,  T-IV-uniform  consistency  and  ( 13 ),  respectively.  ■ 

Here  again,  the  previous  strong  stability  theorem  yields  a  corresponding  stability 
result  for  minimizers  of  the  functional  (3)  in  the  particular  case  in  which  J  and  Jn  are 
of  Tikhonov-Phillips  type.  This  result  is  given  in  the  following  corollary. 

Corollary  3.13.  Let  X  be  a  normed  vector  space,  y  an  inner  product  space,  T,  Tn  e 
C(X,  y),  n  —  1,  2,  •  •  *;  y  e  y,  a  >  0,  V  a  subset  of  X ,  W  :  V  — »  M  a  functional  satisfying 
hypotheses  (HI)  of  Theorem  2.5  and  (12’)  and  (13)  of  Remark  2.11,  J,Jn,n  =  1,2,..., 
functionals  on  V  defined  as  follows: 

J(x)  =  \\Tx-yf +  aW(x),  (19) 

Jn(x)  =  || Tnx  -  yn ||2  +  anW(x),  (20) 

such  that  as  n  — >  oo,  an  — >  a,  yn  — >  y  and  Tnx  — >  Tx  uniformly  on  W -bounded  sets 
(i.e.  {Tn}  is  W -uniformly  consistent  for  T ).  Suppose  further  that  J  has  a  unique  global 
minimizer  x.  If  xn  is  a  global  minimizer  of  Jn  then  xn  — >  x. 

Proof.  We  will  show  that  J  and  {Jn}  satisfy  the  hypotheses  of  Theorem  3.12.  For 
that  it  suffices  to  show  that  J  is  T-lT-sls  and  that  {Jn}  is  T-W  coercive  and  T- 
iT-uiiiformly  consistent  for  J.  The  fact  that  J  is  T-lT-sls  follows  immediately  from 
(12),  the  boundedness  of  T  and  the  continuity  of  the  norm  in  X.  The  T-iT-uniform 
consistency  of  {Jn}  for  J  follows  exactly  as  in  the  proof  of  Corollary  3.4  by  noting 
that  |  Jn(x)  —  J(x)\  <  |  ||Tna;  —  yn\\2  —  || Tx  —  y||2|  +  | (an  —  a)|  |W(x)|  and  using  the 
fact  that  T-lT-bounded  sets  are  also  IT-bounded  and  the  hypothesis  of  the  IT-uniform 
consistency  of  {Tn}  for  T.  Finally,  also  the  T-lT-coercivity  of  { Jn }  follows  easily  from 
the  IT-uniform  consistency  of  {Tn}  for  T.  ■ 

4.  Particular  cases 

In  this  section  we  present  several  examples  of  penalizers  W(-)  for  which  some  of  the 
results  obtained  in  the  previous  section  are  valid  and  therefore,  existence,  uniqueness 
and/or  stability  for  the  minimizers  of  the  corresponding  generalized  Tikhonov-Phillips 
functional  Jw,a(')  in  (3)  are  obtained. 

4-1-  Total  variation  penalization 

Bounded  variation  penalty  methods  have  been  studied  by  Rudin,  Osher  and  Faterni  in 
1992  ([16])  and  Acar  and  Vogel  in  1994  ([1]),  among  others.  These  methods  have  been 
proved  highly  successful  in  certain  image  denoising  problems  where  edge  preserving 
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is  an  important  issue  ([4],  [5],  [6],  [8]).  Let  d  >  2,  fl  C  a  convex,  bounded 
set  with  Lipschitz  continuous  boundary,  1  <  p  <  X  =  Lp(f2),  V  =  BVflfl), 
where  BVflX)  denotes  the  space  of  functions  of  bounded  variations  on  Q.  Recall  that 
BV{VL)  =  {u  G  L1(fl)  :  J0(u)  <  oo},  where  J0(u)  =  supvGi/  fQ(—udivv )  dx  and  Z/  = 
{n  G  Md)  :  |u(x)|  <  1  V  x  G  (for  u  G  C1(fl)  one  has  that  J0(u )  =  fQ  |  Vu|  dx) 

and  for  u  G  BV(Ll)  the  BV  norm  of  u  is  defined  by  |M|BV(n)  =  ||MILi(n)  +  </0(w).  Let  W 
be  the  functional  defined  on  V  by  W(u)  =  ||w||w(n). 

We  will  show  that  W ( • )  satisfies  the  hypotheses  (HI),  (H2)  and  (H3)  of  Theorem 
2.5.  Clearly  W(-)  satisfies  hypothesis  (HI)  with  7  =  0.  Hypothesis  (H3)  follows 
immediately  from  the  compact  imbedding  of  BV(fX)  into  LP(Q)  for  1  <  p  <  -fH  and 
from  the  weak  compact  imbedding  for  p  =  jH.  These  results  are  extensions  of  the 
Rellich-Kondrachov  Theorem  and  can  be  found  for  example  in  [2]  and  [3].  It  only 
remains  prove  that  W(-)  satisfies  hypothesis  (H2).  For  that,  let  {un}  C  V  be  a  Re¬ 
bounded  sequence  such  that  un  u  G  V.  Then,  un  ^  u  (since  p  >  1).  From  the 
weak  lower  semicontinuity  of  the  ||-||Li^  norm  and  of  the  functional  J0(-)  in  L1(H)  (see 
[1]),  it  follows  that 

1 1 ri 1 1  r  1  (ct\  <  liminf  ||wn||  rwoi  and  d0(n)  <  lim inf  J0(wn).  (21) 

^  '  n— >00  ^  '  n— >00 

Then, 


W(u)  =  ||n||w{n)  =  ||m||li(Q)  +  J0{u) 

<  liminf  \\un\\Ll(n)  +  liminf  J0(un )  (by  (21)) 

n— >00  v  ’  n-^00 

<  dm  inf  (||w„||Li(n)  +  J0(«n)) 

=  liminf  || un 1 1 

n— >00  v  ’ 

=  lim  inf  W  (un), 

n— >00 

which  proves  (H2).  Hence  W(-)  satisfies  the  hypotheses  of  Theorem  2.5  and  therefore 
for  any  a  >  0,  T  G  C(X,y),  (y  a  norrned  space)  the  functional 

J\\-\\bvAu)  =  WTu  ~  v\?  +  a\\u\\BV(n)  (22) 


has  a  global  minimizer  on  BV(fX).  If  T  is  injective  then  such  a  global  minimizer  is 
unique.  If  T  is  not  injective  uniqueness  cannot  be  guaranteed  since  the  ||  •  ||w-norm 
is  not  strictly  convex.  Also,  if  p  <  jH  and  J\\.\\BV,a(-)  has  a  unique  global  minimizer, 
then  the  problem  of  finding  such  a  minimizer  is  strongly  stable  under  perturbations  in 
the  model  (T),  in  the  data  (y)  and  in  the  regularization  parameter  (a).  This  follows 
immediately  from  the  fact  that  (H2)  is  stronger  than  (H2’),  the  relative  compactness  of 
BV-bounded  sets  in  Lp(f2)  for  p  <  jH  (see  [10] )  and  Corollary  3.11.  For  p  =  -ifH  and 
d  >  2  the  problem  is  weakly  stable,  by  virtue  of  Corollary  3.4. 


4-2.  Penalization  with  powers  of  semi-norms  associated  to  closed  operators 

Theorem  4.1.  Let  X,  Z  be  reflexive  Banach  spaces,  y  a  norrned  space,  T  G  C(X,y) 
and  L  :  V(L)  C  X  — >  Z  a  closed  linear  operator  such  that  the  range  of  L,  7 Z(L), 
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is  weakly  closed.  Assume  further  that  T  and  L  are  complemented,  i.e.  there  exists  a 
constant  k  >  0  such  that  ||Ta;||2  +  ||7kc||2  >  k  ||a:||2 ,  Vi  6  X>(L).  Then,  for  any  q  >  1, 
a  >  0  and  y  G  y  the  functional 

JL,q,a(x)  =  \\Tx  -  y\\ 2  +  a\\Lx\\\  x  G  V(L),  (23) 

has  a  unique  global  minimizer. 

Proof.  Let  q  >  1,  D  =  D(L)  and  WLq  :  V  — ■>  M+  defined  by  WLiQ(x)  =  ||La;||9.  We  will 
show  that  T  and  WL  q  satisfy  the  hypotheses  (HI),  (H2)  and  (13).  Hypothesis  (HI)  is 
trivially  satisfied  since  WLtV(x)  >  0  V  x  G  V.  To  prove  that  (H2)  holds,  let  { xn }  C  V 
be  a  bb^-bonnded  sequence  such  that  xn  A  x  G  D.  Then  there  exists  a  constant 
c  <  oo  such  that  ||La;n||  <  c  V  n  G  N.  Since  the  Banach  space  Z  is  reflexive,  there  exist 
z  G  Z  and  {xnj}  C  {xn}  such  that  Lxnj  Af  z.  Since  7 Z(L)  is  weakly  closed  z  G  7 Z(L). 
Now,  the  operator  L' ,  the  Moore-Penrose  generalized  inverse  of  L ,  is  continuous  (since 
7 Z(L)  is  closed),  and  therefore  P^L)±xnj  =  VLxnj  Vz  (where  PjV(L)±  is  the 
orthogonal  projection  of  X  onto  Since  xnj  =  PM(L)±xn;j  +  PA;-(L)xnj  it  follows 

that  Pj\f( L)Xn.j  x  —  Lf  z  and  therefore  x  —  Vz  G  J V(L)  (since  J V(L)  is  weakly  closed,  L 

being  closed).  Hence  0  =  L(x  —  lAz)  =  Lx  —  LLfz  =  Lx  —  P^jzjZ  =  Lx  —  z.  Thus  z  =  Lx 
and  WL:q(x)  =  W^x^1  =  ||z||9  <  limmij^00\\Lxnj\\q  =  lim  infj^oo  WL,q(xnj),  where  the 
inequality  follows  from  the  fact  that  Lxnj  — ^  z  and  the  weak  lower  semicontinuity  of 
the  norm  in  Z.  This  proves  (H2). 

To  prove  that  (13)  holds,  let  {xn}  C  V  be  a  T-WLj?-bounded  sequence.  By  the 
complementation  condition  it  follows  that  {xn}  is  bounded  in  X  and  by  the  reflexivity 
of  X  there  must  exist  a  subsequence  {xnj}  C  {xn}  and  x  G  X  such  that  xnj  x.  It 
only  remains  to  be  proved  that  x  G  T>  =  T>(L).  For  that  observe  that  since  {xnj}  is  a 
IW  q-bounded  sequence  such  that  xnj  x ,  following  the  same  steps  as  in  the  proof 
of  (H2)  above,  we  obtain  that  there  exists  z  G  7Z(L)  such  that  x  —  L^z  G  J\f(L).  Since 
Lfz  G  J\f(L)L  C  'D(L)  it  then  follows  that  x  G  'D(L).  This  finally  proves  that  (13)  holds. 

Now,  since  hypothesis  (H2)  implies  hypothesis  (12)  (see  Remark  2.10),  Theorem 
2.9  now  implies  that  for  any  a  >  0,  y  G  y,  the  functional  JLtqtC,(x)  defined  by  (23),  has 
a  global  minimizer  on  T> (L).  Since  q  >  1,  from  the  complementation  condition  it  follows 
easily  that  JLi  a  is  strictly  convex  and  therefore  such  a  global  minimizer  is  unique.  ■ 

It  is  appropriate  point  out  here  that  the  above  hypotheses  on  L  are  satisfied  by 
most  differential  operators  and  that  the  complementation  condition  holds,  for  instance, 
whenever  dimJ\f(L )  <  oo  and  N(T)  C\J\f(L)  =  {0}.  Also,  the  previous  theorem  provides 
existence  for  any  q  >  0.  However  uniqueness  can  only  be  guaranteed  for  q  >  1  and,  if 
T  is  injective,  also  for  q  =  1. 

The  next  Lemma  shows  that  the  problem  of  finding  the  global  minimum  of  (23)  is 
weakly  stable  under  perturbations  on  y ,  a  and  T. 
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Lemma  4.2.  Let  X ,  y,  Z,  T,  L,  V  as  in  Theorem  f.l,  q  >  1,  y ,  yn  e  A\  cp  «n  >  0, 
Tn  e  £(A,  y),  n  =  1,  2, . . .,  and  JL,q,a,  Jn,  n  =  1,  2, ...;  functionals  on  V  defined  by 

JL,q,*{x)  =  || Tx  -  y\\2  +  a  \\Lx\\q  ,  (24) 

Jn(x)  =  \\Tnx  -  yn\\2  +  an\\Lx\\q  .  (25) 

Assume  that  an  a,  yn  y  as  n  oo  and  that  Tnx  ^  Tx  uniformly  for  x  in  L- 
bounded  sets  (i.e.  {Tn}  is  L-uniformly  consistent  for  T ).  Let  x  be  the  unique  minimizer 
°f  JL,q,a  and  xn  a  global  minimizer  of  Jn.  Then  xn  x. 

Proof.  Let  WL  q  :  V  — >  M+  defined  by  WLtV(x)  =  ||Lx||L  In  Theorem  4.1  we  proved 
that  T  and  WLq  satisfy  hypotheses  (HI),  (12)  and  (13).  Since  by  hypothesis  an  — ■»  a, 
yn  — >■  y  and  {Tn}  is  IT,.,t;-uniforrnly  consistent  for  T,  the  Lemma  follows  immediately 
from  Corollary  3.9.  ■ 

From  the  point  of  view  of  applications  of  the  Tikhonov-Phillips  methods,  the  weak 
stability  result  established  by  the  previous  Lemma,  although  important,  could  render 
insufficient.  A  strong  stability  result,  at  least  on  the  data  y  is  highly  desired.  In  the  next 
Lemma  we  show  that  such  a  result  can  be  obtain  by  imposing  an  additional  hypothesis 
to  the  operator  L. 

Lemma  4.3.  Let  X,  Z,  y,  T ,  Tn  L,  V,  q,  WL<q,  y,  yn,  a,  an,  JL^a,  x,  xn  and  Jn,  n  = 
1,  2, ...  as  in  Lemma  f.2.  Assume  further  that  T-L-bounded  sets  are  compact  in  X .  Then 

Xn  ^  X. 

Proof.  In  Theorem  4.1  we  proved  that  T  and  WLiQ  satisfy  hypotheses  (HI)  and  (12). 
Since  hypothesis  (12)  implies  hypothesis  (12’)  and  the  compactness  of  T-L-bounded  sets 
implies  (13)’,  the  lemma  then  follows  from  Corollary  3.13.  ■ 

Remark  4.4.  If  q  =  2,  under  the  same  hypotheses  of  Lemma  f.2  one  can  get  continuity 
of  the  solutions  of  (24)  with  respect  to  a  and  y.  This  can  be  easily  verified  from  the  fact 
that  the  unique  global  minimizer  of  (24)  is  given  by  x  =  ( aL*L  +  T*T)~1T*y.  Thus,  if 
xn  is  the  minimizer  of  (25)  with  Tn  =  T  Vn,  then  one  has  that 

x-xn  =  ( a~an )  ( aL*L  +  T*T)_1  L*Lxn+(aL*L  +  TT)'1  T*(y-yn).( 26) 

Suppose  now  that  an  — >  a  and  yn  — >  y.  Then  by  Lemma  4-%  xn  %  and 
therefore  {xn}  is  bounded.  Also,  since  ||Ta:||2  +  ||La;||2  >  A;||a;||2  it  follows  that  the 
operators  (aL*L +  T*T)1  L*L  and  (aL*L  +  T*T)_1  T*  are  both  bounded.  In  fact 
(aL*L  +  T*T)_1  L*L  <  a-1/  and  (aL*L  +  T*T)_1  <  fcmil^a  ■  Hence,  it  follows  from 
(26)  that  xn  — >  x. 
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4-3.  Penalization  by  linear  combination  of  powers  of  semi-norms  associated  to  closed 
operators 

We  study  here  the  case  of  generalized  Tikhonov-Phillips  regularization  methods  for 
which  the  functional  W ( • )  in  (3)  is  of  the  form  W(x)  =  cq||L,:a;||9i,  where  the  Lf  s 

are  closed  operators.  We  start  with  the  main  existence  and  uniqueness  result. 

Theorem  4.5.  Let  X,  Z\,  Z2, . . . ,  Zn  be  reflexive  Banach  spaces,  y  a  normed  space, 
T  E  C(X,y),  V  a  subspace  of  X ,  L,  :  V  — *  Zi}  i  =  1,2 IV,  closed  linear  operators 
with  IZ(Li)  weakly  closed  for  every  1  <  i  <  N  and  such  that  T,  Li,  L2, . . . ,  LN  are 
complemented,  i.e.  there  exists  a  constant  k  >  0  such  that  ||Ta;||2  +  YliLi  ll-^^ll2  — 
/c||a;||27  W  x  E  V.  Then,  for  any  y  E  y,  a i,  a2, . . . ,  ajy  E  M+  and  q2,  q2,  ■  ■  ■  ,qN  £ 
qi  >  1  Vi  =  1,  2, . . . ,  N,  the  functional 

N 

J(x)  =  || Tx  -  y ||2  +  ^  a*  \\Lix\\qi ,  (27) 

i— 1 

has  a  unique  global  minimizer. 

Proof.  Let  y  E  y,  at  >  0,  q,  >  1,  i  =  1,2, . . . ,  N  and  define  a  =  (aq,  a2, . ... ,  ajv)T,  q  = 
(qi,  q-2, . . . ,  qiy)T ,  the  normed  space  Z  =  (ff)^=1Zi,  L  :  X  — >  Z  as  Lx  = 
(Lix,  L2x,  . . . ,  LNx)T ,  and  the  functional  :  V  — >  Mq  by  W^^s(x)  = 

'f2?=i(Xi\\Lix\\qi ,  so  that  J(x)  =  || Tx  —  y ||2  +  We  will  prove  that  T  and 

satisfy  the  hypotheses  (HI),  (H2)  and  (IS).  In  fact,  (HI)  is  trivial  and  for  (H2), 
let  {xn}  cDbea  ---bounded  sequence  such  that  xn  A  x  E  V.  Then  for  every 
i  =  1,2, . . . ,  N,  the  sequence  {LiXn}y=1  is  bounded  in  Zi  and  since  Z%  is  reflexive  there 
exist  a  subsequence  {xnk}  and  E  Zi  such  that  LiXnk  Af  zt  as  k  — >  oo.  Since  IZ(Li) 
is  weakly  closed,  zt  E  IZ(Li).  By  taken  subsequences,  we  may  assume  that  such  a 
subsequence  is  the  same  for  all  i ,  i.e.  LiXnk  Af  z*  as  k  — >  oo  for  every  i  =  1,2, . . . ,  N. 

Now,  since  TZ(Li)  is  closed,  L\  is  bounded  and  therefore  L\LiXnk  A  L\zi,  as  k  — >  oo, 
for  all  i  =  1,2,  ...,1V.  Since  LjTj  =  Pjg^L,)1-  is  the  orthogonal  projection  of  X  onto 
A f{Lf)L,  writing  xUk  =  PM[Li)±.xnk  +  Pjg(Li)Xnk,  it  follows  that  Pjv(Li)Xnk  x  -  L\zi  as 
k  — >  cx)  and  therefore  x  —  L\Zi  E  A f(Lf)  (being  Af{Lf)  closed,  since  Lj  is  closed).  Hence 
for  all  i  =  1, 2, . . . ,  N,  it  follows  that  0  =  Lflx  —  L\zj)  =  Lpx  —  Pn(L)zt  =  LiX  —  Zi  (where 
the  last  equality  follows  since  z,  E  7 Z(Li) ).  Thus,  zt  =  Ltx  Vi  =  1,  2, . . . ,  N .  Then 

||Lja;||9!  =  ||^||9i  <  hrninf  ||L^nJ9% 

k — >oo 

(where  the  last  inequality  follows  from  the  fact  that  LiXnk  -A  as  k  — >•  oo  and  the  weak 
lower  semicontinuity  of  the  norm  in  Zf),  and  therefore 

N  N 

WL,q,a(X )  =  ^}2ai\\LiX\\qi  <  ^  ai  lip  \\Lixnk\\qi 
i= 1  i=l 

N 

<  lim  inf  V  on\\LiXnk \(h  =  lim  inf  WrjJxnk ) . 

k — >oo  ‘  k — >oo 

i=  1 
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Thus  (H2)  holds.  That  (13)  also  holds  follows  from  the  complementation  condition  and 
the  reflexivity  of  X ,  following  the  same  steps  as  in  Theorem  4.1.  Since  (H2)  implies  (12), 
it  now  follows  from  Theorem  2.9  that  the  functional  J(x)  in  (27)  has  a  global  minimizer 
on  T>.  Moreover,  since  q,  >  1  for  all  i,  it  follows  from  the  complementation  condition 
that  </(•)  is  strictly  convex  and  therefore  such  a  minimizer  is  unique.  ■ 

Under  the  same  hypotheses  of  Theorem  4.5  one  has  that  the  solution  of  (27)  is 
weakly  stable  under  perturbations  in  the  data  y,  in  the  parameters  cq  and  in  the  model 
operator  T.  More  precisely  we  have  the  following  result. 

Lemma  4.6.  Let  all  the  hypotheses  of  Theorem  f.5  hold.  Let  also  y,yn  G  y, 
Tn  G  C(X,y),  n  =  1,2,...,  such  that  yn  — ■>  y,  {Tn }  is  L-uniformly  consistent  for 
T  and  for  each  i  —  1,  2, . . . ,  N,  let  {ck™}^  C  M+  such  that  af  — >  cq  as  n  — >  oo.  If  xn 
is  a  global  minimizer  of  the  functional 

N 

Jn(x)  =  \\Tnx  -  yn\\2  +  ^a"||Lix||9<,  (28) 

i=  1 

then  xn  A  x,  where  x  is  the  unique  minimizer  of  (27). 

Proof.  Let  W  =  bFg as  in  Theorem  4.5.  From  the  hypotheses  it  follows  easily  that 
{Jn}  is  T-bF-coercive  and  lU-uniformly  consistent  for  J. 

Let  xn  be  the  unique  minimizer  of  Jn.  Then  Jn(xn)  <  Jn(x),  Vn.  Therefore 

limsup  Jn(xn)  <  lim  sup  Jn{x)  =  J(x)  <  oo,  (29) 

oo  n^>  oo 

where  the  equality  follows  from  the  iU-uniform  consistency  of  {Jn}  for  J .  But  since 
{Jn}  is  T-bU-coercive  it  then  follows  that  {xn}  is  T-bU-bounded.  We  claim  that  xn  A  x. 
In  fact,  suppose  that  is  not  the  case.  Then,  there  exists  a  subsequence  {xUj}  C  {xn} 
such  that  no  subsequence  of  {xnj}  converges  weakly  to  x.  But  since  {xnj }  is  T-W- 
bounded  and  X  is  reflexive,  there  exist  x*  x  and  \xn.  }  C  { xn .}  such  that  xn,  x*. 
Following  the  same  steps  as  in  Theorem  4.5  we  obtain  that  there  exists  a  subsequence 
{xnjk  }  C  {xn.lk  }  and  z,  G  Zt,  i  =  1,  2, . . . ,  N ,  such  that  LiXnjk  —fzt~  LiX*  as  I  — ■»  oo,, 
Vi  =  1,  2, . . . ,  N,  and 

W(x*)  <  lim  inf  bF  (xn.  ).  (30) 

£ — >cxD  V  3k£  J 

Also,  since  {xn.  }  is  bU-bounded  and  {Jn }  is  bU-uniformly  consistent  for  J ,  it  follows 
that 

Ui(J(x"«,)-wK,))  =  °-  (31) 

Hence 

J(x*)  =  \\Tx*  —  y\\2  +  W  (x*) 

<  lim  inf  \\Txn.  —  y\\2  +  lim  inf  W(xn  ) 

i — xx)  3ki  £ — >oo  3ki 

-  “sU  - »“2  +  w'(x“«,)) 


(by  (30)  ) 
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=  lim  inf  J  ( x 

£ — >oo 


"Ik* 


<  lim  slip  j(x  ) 

v — x  *  ' 


£ — >-00 

=  lim  sup 

£ — >oo 


J  I  Xn3kP 


J n 


v3k, 


<  lim  sup  (  J  (  xr 

£ — >oo  ' 

=  lim  sup  Jn  ixn 

t— >oo 


Jnik , 


<  J{x) 


(x"%)) 

(by  (31) ) 

(by  (29)  since  {xUjk  }  C  {xn} ) 


Since  x  is  the  unique  minimizer  of  J  it  would  then  follow  that  x*  =  x,  contradicting  our 
previous  result  that  x*  ^  x.  This  contradiction  came  from  the  assumption  that  xn  did 
not  converge  weakly  to  x.  Hence  xn  x.  ■ 


Lemma  4.7.  Under  the  same  hypotheses  of  Lemma  f.6,  if  T -L-bounded  sets  are  compact 
in  V,  then  strong  stability  holds,  i.e.,  xn  — >  x. 


Proof.  Let  xn  denote  the  global  minimizer  of  Jn  and  W  =  In  Lemma  4.6  it 

was  proved  that  the  sequence  {xn}  is  T-IT-bounded.  Suppose  that  xn  x.  Then 
there  exists  a  subsequence  { xnj }  C  {rrn}  such  that  no  subsequence  of  { xnj }  converges 
to  x.  But  since  {xnj}  is  T-IT-bounded,  now  by  compactness  hypothesis  there  must  exist 
x*  G  V,  x*  ^  x,  and  a  subsequence  {xnjk}  C  {xn.}  such  that  xnjk  — >  x*  as  k  — *  oo. 
Using  the  IT-uniform  consistency  of  {Jn}  for  J  and  following  similar  steps  as  in  Lemma 
4.6  one  obtains  that  J(x*)  <  J{x).  Since  x  is  the  unique  minimizer  of  J  it  would  then 
follow  that  x*  =  x,  contradicting  our  previous  result  that  x*  x.  Therefore  we  must 
have  that  xn  — >  x.  ■ 


Remark  4.8.  Here  again,  for  the  case  q%  =  2  Vi,  strong  continuity  of  the  solution 
of  the  functional  J(x)  in  (27)  with  respect  to  the  data  y  and  the  parameters  oti  follow 
without  any  further  hypotheses  than  those  in  Lemma  f.6.  This  result  follows  easily 
from  the  fact  that  in  such  a  case  the  unique  global  minimizer  of  (27)  is  given  by 

x  =  ^ T*T  +  cqT*T;)  T*y.  Thus,  if  xn  is  the  minimizer  of  (28)  with  Tn  —TWn, 

then  one  has  that 


N 


- 1 


N 


T*T  +  ^  a,L*Lt  L* 

i= 1  J  i= 1 

f  N  \~1 

m^aUlb)  T*(y-yn). 


Xr 


i=  1 


(32) 


Now,  from  the  complementation  condition  ||Ta;||2  +  ||Tja;||2  >  /c||a;||2,Va:  G  V,  it 

follows  easily  that 


0  < 


TV  \ 

»=i  / 


< 


i 

/cmin(l,mini<i<jvQ;i)’ 


(33) 
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and  also 


/  N  \ 

N 

(  T*T  +  ^  atViLl 

Li  X 

V  4—1  / 

1=1 

< 


maxi<j<jv  |<  -  oii  \ 


millKKAf  Cti 

Using  (34)  and  (33)  in  (32)  we  obtain  that 


|x||,  Vi  6  D. 


\x-XvW  < 


maxi<j<jv  |cq  —  cq| 

mini<j<jv  oii 


\xn\\  + 


IIT’II 


k  min  (1,  mini<j<jv  cq 


(34) 


ll»-»n||-(36) 


Now  since  by  Lemma  4-6  xn  A  x,  it  follows  that  {xn}  is  bounded.  Since  yn  — >  y  and 
af  — ■>  cq  V i  =  1,  2, . . . ,  N,  as  n  — >  oo?  finally  follows  from  (35)  that  xn  — >  x. 


5.  Applications  to  Image  Restoration 

The  purpose  of  this  section  is  to  present  an  application  to  a  simple  image  restoration 
problem.  The  main  objective  is  to  show  how  the  choice  of  the  penalize!'  in  a  generalized 
Tikhonov-Phillips  functional  can  affect  the  reconstructed  image. 

The  basic  mathematical  model  for  image  blurring  is  given  by  the  following  Fredholm 
integral  equation 

K  f(x,y)  =  J  J^k(x,y,x',y')f(x',y')dx'dy'  =  g(x,y),  (36) 

where  C  M2  is  a  bounded  domain,  /  G  X  =  L2{Ul)  represents  the  original  image  and 
k  is  the  so  called  “point  spread  function”  (PSF).  For  the  examples  shown  below  we  used 
a  PSF  of  “atmospheric  turbulence”  type 

k(x,y,x',y')  =  ^  exp  (-*  \\{x.y)  -  (x',  y/)||2)  ,  (37) 

with  k  =  6.  It  is  well  known  that  with  this  PSF  the  operator  K  in  (36)  is  compact 
with  infinite  dimensional  range  and  therefore  K\  the  Moore-Penrose  inverse  of  K,  is 
unbounded. 

Generalized  Tikhonov-Phillips  methods  with  different  penalizers  where  used  to 
obtain  regularized  solutions  of  the  problem 

Kf  =  g.  (38) 

The  data  g  was  contaminated  with  a  1%  zero  mean  Gaussian  noise  (i.e.  standard 
deviation  of  the  order  of  1%  of  ||5'||cc).  Minimizers  of  functionals  of  the  form 

Ja(f)  =  \\K f  —  g\\2  -{-  aW (/)  (39) 

were  found  for  different  penalizers  W(f),  where  g  represents  the  noisy  version  of  g.  In 
all  cases  the  value  of  the  regularization  parameter  a  was  approximated  by  using  the 
L-curve  method  ([9],  [12],  [13]). 

Figures  1(a)  and  1(b)  show  the  original  image  (unknown  in  real  life  problems) 
and  the  blurred  noisy  image  which  constitutes  the  data  for  the  inverse  problems, 
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respectively.  Figures  1(c)  and  1(d)  show  the  reconstructions  obtained  with  the  classical 
Tikhonov-Phillips  methods  of  order  zero  and  one,  corresponding  to  W(f)  =  ||/||2  and 
W(f)  =  IIV/II2,  respectively. 


(a)  Original  image  (unknown). 


(b)  Blurred  noisy  image  (data). 


A 


(c)  Tikhonov-Phillips  of  order  (d)  Tikhonov-Phillips  of  order 
zero,  W(f)  =  ll/ll2.  one,  W(f)  =  ||V/||2. 


Figure  1.  Original  image  (a),  blurred  noisy  image  (b)  and  regularized  solutions 
obtained  with  the  classical  Tikhonov-Phillips  methods  of  order  zero  (c)  and  one  (d). 

Figures  2(b)  and  2(c)  show  the  reconstructions  obtained  with  a  structural 
information  penalizer  of  the  form  W(f)  =  ||L/||2  where  the  operator  L  is  constructed 
as  in  [14],  including  the  information  of  the  curve  7  depicted  in  Figure  2(a),  where  it  is 
expected  that  the  original  image  have  steep  gradients.  The  operator  L  is  constructed 
so  as  to  capture  this  structural  prior  information.  The  discretization  of  L  is  given  by 
fn  ||A(a;)V/(a;)||2  dx  with  A{x)  =  /  —  (1  +  c|| Vy(a;)||2)^1  Vy(x)  (Vy(x))T,  where  c  is  a 
positive  constant.  In  this  way,  if  ||V7(x)||  is  large,  the  functional  W(f)  penalizes  only 
very  mildly  all  intensity  changes  occurring  in  the  direction  of  Vy(x)  (see  [14]  for  more 
details). 
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(a)  The  curve  7  providing  the  (b)  Structural  penalizer  W(f)  = 
structural  information.  ||L/||,  c  =  5. 


Figure  2.  Structural  information  (a),  reconstructed  image  with  structural  information 
penalizer  and  c  =  5  (b)  and  c  =  20  (c) 

Figures  3(a)  and  3(b)  correspond  to  images  reconstructed  with  hybrid  Tikhonov- 
structural  penalizers  W(f)  =  |||/||2  +  ^||T/||2,  with  c  =  5  and  c  =  20,  respectively. 

A  comparison  of  the  images  obtained  with  the  different  methods  clearly  show  that 
the  choice  of  the  penalizer  in  Tikhonov-Phillips  method  can  greatly  affect  the  obtained 
approximated  solution.  In  this  particular  case  we  observe  how  the  classical  order- zero 
method  tends  to  smooth  out  boundaries  and  edges  and,  while  the  order-one  method  does 
a  better  job,  the  inclusion  of  the  structural  information  through  the  operator  L  results 
in  a  significant  improvement.  Although  the  main  objective  of  this  article  is  theoretical 
in  nature,  providing  sufficient  conditions  on  the  model  operators  and  the  penalizers 
for  the  existence,  uniqueness  and  stability  of  solutions  of  the  corresponding  generalized 
Tikhonov-Phillips  methods,  the  previous  applications  to  image  restoration  were  included 
to  better  emphasize  the  importance  of  the  adequate  choice  of  the  penalizer. 
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Figure  3.  Recostructed  images  with  hybrid  penalizers:  W(f)  =  |||/||2  +  |||L/||2; 
c  =  5  (a)  and  c  =  20  (b) 


6.  Conclusions 

In  this  article  sufficient  conditions  on  the  penalizers  in  generalized  Tikhonov-Phillips 
functionals  guaranteeing  existence,  uniqueness  and  stability  of  the  minimizers  where 
found.  The  particular  cases  in  which  the  penalizers  are  given  by  the  bounded  variation 
norm,  by  powers  of  seminorms  and  by  linear  combinations  of  powers  of  seminorms 
associated  to  closed  operators,  were  studied.  Several  examples  were  presented  and  a 
few  results  on  image  restoration  were  shown  to  illustrate  how  the  choice  of  the  penalizer 
can  greatly  affect  the  regularized  solutions. 
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